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DETAILED ACTION 

Claim Rejections - 35 USC § 101 
1. 35 U.S.C. 101 reads as follows: 

Whoever invents or discovers any new and useful process, machine, manufacture, or composition of 
matter, or any new and useful improvement thereof, may obtain a patent therefor, subject to the 
conditions and requirements of this title. 

Claims 15 and 17 are rejected under 35 U.S.C. 101 because they claim a 
computer program which is non-statutory. 

A). The computer program as claimed doesn't isn't properly associated with the 
operation. It is quite possible that the computer program may be an unrelated sub- 
routine or a simple commence instruction which then causes the computer to execute 
the operation that could be self-resident, and not encoded on the medium. The 
Examiner suggests that the computer program be more directly associated with the 
operation, Interim Guidelines, Annex IV (Section b). 
Corrections to the claims, and supporting specification are required. 



Claim Rejections - 35 USC §112 

2. The following is a quotation of the second paragraph of 35 U.S.C. 112: 

The specification shall conclude with one or more claims particularly pointing out and distinctly 
claiming the subject matter which the applicant regards as his invention. 

3. Claim 1 is rejected under 35 U.S.C. 112, second paragraph, as being indefinite 
for failing to particularly point out and distinctly claim the subject matter which applicant 
regards as the invention. 



Application/Control Number: 10/588,404 Page 3 

Art Unit: 2621 

Regarding Claim 1, it cites "the relevant GOP" which is not previously described 
in the claim. Therefore, it is indefinite. 

Claim Rejections - 35 USC § 103 

4. The following is a quotation of 35 U.S.C. 1 03(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

5. Claims 1, 3-8, 10-14, 16, and 18 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Kimata (CIT 2004, IEEE) (hereafter referenced as Kimata), in view 
of Puri (Signal Processing Image Communication 2, 1990, pp. 127-144) (hereafter 
referenced as Puri). 

Regarding claim 1, Kimata discloses System Design of Free View point Video 
Communication. Kimata specifically discloses A video encoding method (4. Coding 
Method, pp.4- pp.5) for assigning a plurality of images (Fig. 6 -7) to a plurality of GOPs 
(Group of GOP (GoGop), Fig. 6-7) and encoding images belonging to the GOPs as a 
video image, the method comprising: 

a GOP encoding determination step of determining whether each image belonging to 
each GOP (Fig. 6-7 show that each camera view is encoded as different GOP's) is to be 
encoded; 
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However, Kimata fails to disclose a GOP encoding/non-encoding data encoding step of 
encoding GOP encoding/non-encoding data for indicating whether encoded data of the 
image belonging to the relevant GOP is output, and an in-GOP image encoding step of 
encoding the image belonging to the relevant GOP when the encoded data of the image 
is output. 

In the analogous field of endeavor, Puri discloses Video Coding with Motion - 
Compensated Interpolation for CD-ROM Application. Puri specifically discloses 
conditional motion compensated interpolation (CMCI) which is interpolating the skipped 
frames using motion compensated interpolation based on other reference frames, but 
encoding the interpolation error only if it is significant (4. Motion-Compensated 
Interpolation, pp.1 30-1 31), in order to keep the additional information as small as 
possible (pp.1 31 , left col, line 9-1 1 ). Kimata teaches that the interpolation of the image 
belonging to the relevant GOP is done by Ray-Space method (Kimata: Ray-Space 
Interpolation, Fig. 3 and 4) based on other GOP's (Inter-GOP configuration of Fig. 7(b)). 

Therefore, given this teaching, it would have been obvious to one of ordinary skill 
in the art at the time invention was made to modify Kimata by incorporating selectively 
encoding the image belonging to the relevant GOP based on the significance of 
interpolation error with transmission of encoding/non-encoding information (1 bit), in 
order to in order to keep the additional information as small as possible. 
However Kimata and Puri still fail to disclose an in-GOP image encoding step of 
encoding the image belonging to the relevant GOP when the encoded data of the image 
is output. 
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However Kimata already discloses an in-GOP image encoding step (base GOP) 
of encoding the image belonging to other Camera (d and c2). So an in-GOP image 
encoding step of encoding the image belonging to the relevant GOP is always possible 
mode and it will be chosen when there is less bandwidth limitation, in order to adaptively 
select between In-GOP (base-GOP) and no-encoding based on bandwidth limitation. 

Therefore, given this motivation, it would have been obvious to one of ordinary 
skill in the art at the time invention was made to modify Kimata and Puri by 
incorporating in-GOP image encoding step of encoding the image belonging to the 
relevant GOP, in order to adaptively select between In-GOP (base-GOP) and inter- 
GOP based on bandwidth limitation. The Kimata coding method, incorporating the Puri 
selective encoding based on the significance of interpolation error, further incorporating 
adaptive selection of In-GOP and non-encoding based on the bandwidth limitation, has 
all the features of claim 1 . 

Regarding claim 3, the Kimata coding method, incorporating the Puri selective 
encoding based on the significance of interpolation error, further incorporating adaptive 
selection of In-GOP and non-encoding based on the bandwidth limitation, as applied to 
claim 1, teaches further comprising: a generation reference-GOP encoding step of 
encoding generation reference-GOP designating data for designating one or more other 
GOPs (Kimata: reference GOP index are defined in GOP header, pp.4, left col, last 3 
lines ) which are used for generating the image (Kimata: Ray-Space Interpolation, Fig. 3 
and 4) belonging to the relevant GOP when the encoded data of this image is not 
output (No-encoding shown in above claim 1) . 
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Regarding claim 4, the Kimata coding method, incorporating the Puri selective 
encoding based on the significance of interpolation error, further incorporating adaptive 
selection of In-GOP and non-encoding based on the bandwidth limitation, as applied to 
claim 1, teaches further comprising: 

a generation data encoding step of encoding generation data (Ray-Space Approach 
used as View Generation, pp.3, left col.) for designating an image generation method 
which is used for generating the image (3. Free viewpoint viewer, pp.2) belonging to 
the relevant GOP (Fig.7(b). GoGOP #2 uses only decoded picture of base GOP (GOP 
of Other Camera's) ) when the encoded data of this image is not output (no-encoding 
shown in above claim 1). 

Regarding claim 5, The Kimata coding method, incorporating the Puri selective 
encoding based on the significance of interpolation error, further incorporating adaptive 
selection of In-GOP and non-encoding based on the bandwidth limitation, as applied to 
claim 1, discloses A video decoding method (Kimata: Fig. 8 Decoder) for decoding 
encoded data generated by assigning a plurality of images (Kimata: Fig. 6 -7) to a 
plurality of GOPs and encoding images belonging to the GOPs (Kimata: Group of GOP 
(GoGop), Fig. 6-7) as a video image, the method comprising: 
a GOP encoding/non-encoding data decoding step (anticipated by the combination, 
because there is a bit indication encoding-non-encoding as shown above claim 1) of 
decoding GOP encoding/non-encoding data for indicating whether the encoded data of 
each image belonging to each GOP is to be decoded (definition of encoding/non- 
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encoding bit); and an in-GOP image decoding step (Fig. 8 includes in-GOP as well as 
inter-GOP) of decoding the image belonging to the relevant GOP when the encoded 
data of the image is decoded. 

Regarding claim 6, the Kimata coding method, incorporating the Puri selective 
encoding based on the significance of interpolation error, further incorporating adaptive 
selection of In-GOP and non-encoding based on the bandwidth limitation, as applied to 
claim 1, teaches further comprising: 

a generation reference-GOP decoding step of decoding generation (Kimata: Reference 
Picture Determination, Fig. 8) reference-GOP designating data for designating one or 
more other GOPs (Kimata: reference GOP index are defined in GOP header, pp.4, left 
col, last 3 lines ) which are used for generating the image (Kimata: Ray-Space 
Interpolation, Fig. 3 and 4) belonging to the relevant GOP when the encoded data of this 
image is not decoded (No-encoding shown in above claim 1, Kimata: Fig. 7b shows 
reference pictures only with other cameras). 

Regarding claim 7, the Kimata coding method, incorporating the Puri selective 
encoding based on the significance of interpolation error, further incorporating adaptive 
selection of In-GOP and Inter-GOP based on the bandwidth limitation, as applied to 
claim 1, teaches further comprising: 

a generation data decoding step of decoding generation data for designating an 
image generation method which is used for generating the image (Kimata: Ray-Space 
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Interpolation, Fig. 3 and 4) belonging to the relevant GOP(C2 images in Fig 7(b)) when 
the encoded data of this image is not decoded (no-encoding shown in above claim 1). 

Regarding claim 8, the claimed invention is an apparatus claim corresponding to 
the method claim 1 . Therefore, it is rejected for the same reason as claim 1 . 

Regarding claim 10, the claimed invention is an apparatus claim corresponding 
to the method claim 3. Therefore, it is rejected for the same reason as claim 3. 

Regarding claim 11, the claimed invention is an apparatus claim corresponding 
to the method claim 4. Therefore, it is rejected for the same reason as claim 4. 

Regarding claim 12, the claimed invention is an apparatus claim corresponding 
to the method claim 5. Therefore, it is rejected for the same reason as claim 5. 

Regarding claim 13, the claimed invention is an apparatus claim corresponding 
to the method claim 6. Therefore, it is rejected for the same reason as claim 6. 

Regarding claim 14, the claimed invention is an apparatus claim corresponding 
to the method claim 7. Therefore, it is rejected for the same reason as claim 7. 

Regarding claim 16, the claimed invention is a computer-readable medium claim 
corresponding to the method claim 1 . Therefore, it is rejected for the same reason as 
claim 1. 

Regarding claim 18, the claimed invention is a computer-readable medium claim 
corresponding to the method claim 5. Therefore, it is rejected for the same reason as 
claim 5. 
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6. Claims 2 and 9 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Kimata in view of Puri , and further in view of Eifrig (US 5,991 ,447) (hereafter 
referenced as Eifrig). 

Regarding claim 2, the Kimata coding method, incorporating the Puri selective 
encoding based on the significance of interpolation error, further incorporating adaptive 
selection of In-GOP and non-encoding based on the bandwidth limitation, as applied to 
claim 1 , teaches image generated by using one or more other GOPs without decoding 
the encoded data of the relevant GOP (no-encoding, but interpolated by other GOP's 
using Ray-Space), and encoding the relevant GOP. 

However, the combination fails to teach the GOP encoding determination step includes 
determining whether an image generated by using one or more other GOPs without 
decoding the encoded data of the relevant GOP is closer to an original image of the 
relevant image in comparison with an image obtained by decoding the 
encoded data, so as to determine whether the image belonging to the relevant 
GOP is to be encoded. 

In analogous field of endeavor, Eifrig discloses Prediction and Coding of Bi- 
Directionally Predicted Video Object Planes for Interlaced Video. Eifrig specifically 
discloses that prediction mode is decided based on SAD (sum of absolute difference 
between prediction and the current picture) {closeness to the original picture) 
calculation of forward, backward, and averaged mode, in order to do efficient coding 
(col. 14, line 16-24). 
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Therefore, given this teaching, it would have been obvious to one of ordinary skill 
in the art at the time invention was made to modify Kimata and Puri by incorporating the 
mode decision based on minimum SAD between In-GOP encoding and non-encoding of 
the relevant image, in order to do efficient coding. The Kimata coding method, 
incorporating the Puri selective encoding based on the significance of interpolation 
error, incorporating the mode decision based on minimum SAD between In-GOP 
encoding and no-encoding of the relevant image, has all the features of claim 2. 

Regarding claim 9, the claimed invention is an apparatus claim corresponding to 
the method claim 2. Therefore, it is rejected for the same reason as claim 2. 



Conclusion 

7. The prior art made of record and not relied upon is considered pertinent to 
applicant's disclosure. Pfister (US 2005/0,185,71 1) discloses 3D Television System and 
Method. Visharam (US 2006/0,047,674) discloses Method and Apparatus for 
Supporting Storage of Multiple Camera Views. 

8. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to HEE-YONG KIM whose telephone number is (571)270- 
3669. The examiner can normally be reached on Monday-Thursday, 8:00am-5pm EST. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Marsha Banks-Harold can be reached on 571-272-7905. The fax phone 
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number for the organization where this application or proceeding is assigned is 571- 
273-8300. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 

/HEE-YONG KIM/ 
Examiner, Art Unit 4192 



/Andy S. Rao/ 

Primary Examiner, Art Unit 2621 
April 22, 2010 



